Laplacian Spectra as a Diagnostic Tool for Network Structure and Dynamics. 
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Abstract 

We examine numerically the three-way relationships among structure, Laplacian spectra and frequency synchronization 
dynamics on complex networks. We study the effects of clustering, degree distribution and a particular type of coupling 
asymmetry (input normalization), all of which are known to have effects on the synchronizability of oscillator networks. We 
find that these topological factors produce marked signatures in the Laplacian eigenvalue distribution and in the localization 
properties of individual eigenvectors. Using a set of coordinates based on the Laplacian eigenvectors as a diagnostic tool 
for synchronization dynamics, we find that the process of frequency synchronization can be visualized as a series of quasi- 
independent transitions involving different normal modes. Particular features of the partially synchronized state can be 
understood in terms of the behavior of particular modes or groups of modes. For example, there are important partially 
synchronized states in which a set of low-lying modes remain unlocked while those in the main spectral peak are locked. We 
find therefore that spectra influence dynamics in ways that go beyond results relating a single threshold to a single extremal 
eigenvalue. 
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I. INTRODUCTION 



In the recent intense activity that has focused on com- 
plex networks [l]-[4], one goal has been to identify prop- 
erties of networks that are important for their function 
and behavior. A number of concepts have been in- 
troduced for classifying network structures, for exam- 
ple degree distribution, path length [5], clustering [6], the 
small- world property [6] [4], modularity, betweenness[7], 
etc. Diagnostic tools for assessing function include 
percolation properties, robustness against node or link 
deletion [8], studies of epidemic spreading [9], and various 
measures of synchronizabilty. Synchronization can be 
approached by means of global order parameters [10] [11] 
or stability analyses of fully synchronized [12] or fully 
incoherent [11] [13] states, which give thresholds for the 
onset of either synchronization or desynchronization. 

One way of distilling information about a network is 
to analyze the eigenvalue and eigenvector spectra of ma- 
trices associated with the network, and that is the fo- 
cus of this paper. Such spectral properties provide 
an important intermediary between structural and dy- 
namical properties. They are derived directly from 
the network topology and many relations exist between 
particular eigenvalues and important network structural 
properties[14][15][16], while a number of studies have re- 
lated extremal eigenvalues to dynamical properties and 
thresholds. [12] [13] In the current paper we use spectral 
tools to diagnose the dynamics of partial synchronization, 
between the incoherent and fully coherent states. 

The important matrices are derived from either the ad- 
jacency or coupling matrix. The adjacency matrix Aij 
is defined by Aij = 1 if a connection exists between the 
nodes numbered i and j and = otherwise. The 
coupling matrix Wij is simply the matrix of coupling 
strengths among nodes, and if the links are all equally 
weighted then it is a multiple of the adjacency matrix. 



Several definitions of the Laplacian matrix are in use. We 
will define it here as 



Li 



Wi, 



(1) 



In the case where Wij — A^, this matrix is sometimes 
known as the "combinatorial Laplacian." [17] The defini- 
tions and significance of these matrices will be discussed 
further in the following sections. 

Some applications of network matrices depend only on 
one or two extremal eigenvalues. A widely known ap- 
plication of the Laplacian matrix is the Master Stability 
Function (MSF) technique for analyzing the stability of 
a synchronized state of coupled oscillators. [12] For the 
MSF, the quantity of interest is the ratio of the largest 
to the smallest nonzero eigenvalue of the Laplacian, and 
accordingly many studies of the Laplacian spectrum on 
complex networks are limited to tabulations of this ratio. 
In mathematical graph theory, a number of theorems 
relate geometrical properties such as the diameter of the 
network to the smallest nonzero eigenvalue [15]. Like- 
wise with the adjacency matrix, for some applications 
it is only the largest eigenvalue that matters. For ex- 
ample, under certain assumptions, approximate relations 
were derived between the largest eigenvalue of the adja- 
cency matrix and the critical coupling strength for the 
onset of phase synchronization in a network of limit cy- 
cle oscillators. [13] 

In many cases, however, there is additional important 
information contained in the full spectrum and in the 
eigenvectors themselves. The Laplacian spectrum, for 
example, is relevant to the solution of diffusion and flow 
problems on networks [15]. Apart from the MSF formal- 
ism, it is applicable more generally to the dynamics of 
coupled oscillators near the synchronized state, including 
the relaxation of coupled identical limit-cycle oscillators 
to equilibrium. [18] In a previous paper [19], we showed 
that the eigenvectors of the Laplacian form a useful co- 
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ordinate system in which to view the dynamics of partly 
synchronized networks of oscillators, even at a significant 
distance from full synchronization. 

There have been relatively few efforts to study the full 
spectrum of the Laplacian as defined in (1) for general 
complex networks. In the mathematical literature, more 
attention has often been paid to the adjacency matrix[14] 
or the so-called "normalized Laplacian" [16] [17] which 
is related to L but can have a quite different spec- 
trum. Studies of the combinatorial Laplacian[15] are 
not often focused on applications to large complex net- 
works. There have been some numerical and ana- 
lytical studies of the adjacency matrices of complex 
networks[20] [21] [17] [22] as well as some studies of the nor- 
malized Laplacian[17] and of the closely related "transi- 
tion matrix" [22] on one category of random uncorrelatcd 
networks with given expected degree distributions. As for 
the Laplacian defined in (1), its full spectrum has been 
examined on random Erdos-Renyi [23] and small-world 
networks [24] but much of the territory is still relatively 
uncharted, especially in the case of networks with degree 
correlations, clustering, communities, and other types of 
correlations. 

The current paper explores the information contained 
in the Laplacian spectrum, and the three-way linkage 
among network topology, spectrum and dynamics, in par- 
ticular oscillator synchronization dynamics. One goal 
is simply to characterize the Laplacian eigenvalues and 
eigenvectors for several important types of networks. We 
pay attention to the spectral and dynamical effects of net- 
work topological properties such as degree distribution 
(especially Poisson vs. scale-free or homogeneous vs. het- 
erogeneous), clustering (i.e., the tendency of neighbors of 
a given node to form links with each other) , and commu- 
nity structure, also known as modularity. While recent 
studies of network matrix spectra have dealt with ran- 
dom network models without correlations, modularity 
and clustering represent significant new ingredients. In 
addition, we consider weighting and symmetry or asym- 
metry of connection strengths, especially the asymmetric 
connection scheme in which the total input to each node 
is normalized. We are interested in the latter coupling 
scheme because it is known to optimize synchronizability 
in MSF terms. [25] [26] 

Beyond the mere classification of spectra, another goal 
is to understand dynamics. For the types of networks 
studied, we consider the synchronization dynamics of 
coupled phase oscillators (the Kuramoto[ll] model), us- 
ing coordinates based on the Laplacian eigenbasis as a 
tool for visualizing the dynamics and revealing structure 
within the synchronization transition. This program 
follows the general inspiration of the MSF technique in 
that the aim is to use the Laplacian spectrum to iso- 
late topological influences on synchronization, as distinct 
from the individual node dynamics. The MSF, how- 
ever, is strictly applicable only to the stability problem 
of a fully synchronized state of a set of exactly identical 
oscillators. It is most useful for networks of identical 



chaotic oscillators. For appropriately limited questions, 
the MSF, relying only the cigenratio, gives rigorous an- 
swers. The present work, on the other hand, seeks 
rather more heuristic tools for much broader questions. 
We consider non-identical oscillators and we consider the 
process of synchronization from its onset up to nearly 
complete synchronization, rather than being limited to 
the immediate neighborhood of the synchronization man- 
ifold. The current paper follows a Brief Report [19] in 
which a subset of our results was presented. We expand 
on those results here by studying a greater variety and 
larger sample of networks and by examining properties 
of the individual eigenvectors such as localization and 
degree bias. 

The remainder of the paper is organized as follows: 
Section II discusses some general properties of the Lapla- 
cian matrix that are relevant to network dynamics. Sec- 
tion III is devoted to a description of particular network 
Laplacian eigenvalue spectra and their dependence on 
topological properties. In section IV we then consider 
some properties of the eigenvectors themselves, especially 
localization and degree bias. Finally, in section V, we 
examine some connections between spectra and dynam- 
ics in the case of a network version of the Kuramoto 
model. A coordinate system for phase space based on 
the Laplacian eigenvectors proves useful for obtaining a 
geometric picture of the oscillators' dynamical behavior. 
Under some conditions, groups of eigenvectors behave as 
dynamically independent degrees of freedom and the pro- 
cess of synchronization amounts to a contraction of phase 
space onto progressively lower-dimensional submanifolds 
spanned by lower-eigenvalue eigenvectors. The conclud- 
ing section VI summarizes our results and suggests some 
future directions. 



II. PROPERTIES AND SIGNIFICANCE OF THE 
LAPLACIAN 

We begin by reviewing and extending some known gen- 
eral properties of the Laplacian of a network of N nodes. 
We denote the V-component eigenvectors and associated 
eigenvalues respectively by V" and A Q , so that 

N 

Y,L ij V J a = \ a V<*. (2) 

From the definition (1) it follows that the sum of ma- 
trix elements in any row is zero, and consequently the 
constant vector (1, 1, ...1) is always an eigenvector with 
eigenvalue zero. If the coupling matrix is symmetric 
(Wij = Wji) then so is the Laplacian, and therefore all 
eigenvalues are real and eigenvectors corresponding to 
different eigenvalues are orthogonal. The trace of L is 
given by 

TrL = E^=EE W H ~ E W ™ ■ ( 3 ) 

i j i i 
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(From now on, limits of summations are suppressed and 
assumed to be from 1 to N unless otherwise indicated.) 
If self-couplings are excluded, then the final term van- 
ishes as Wu = 0. If, furthermore, Wij = Aij (i.e., all 
couplings equally weighted) then the row sum of W is 
just the degree (or number of neighbors) of each node, 
and so 

^A Q = TrL = ^fc i; (4) 

a i 

where h = ^ • Wij is the degree of the ith node. Some 
authors (e.g., [15]) define the quantity J2j Wij as the 
" degree" even when the couplings Wij are not only zeros 
and ones. However, it is useful to be able to distinguish 
the sum of couplings from the actual number of nodes 
to which a given node is connected. In cases of possible 
confusion, we suggest the term "topological degree" for 
the latter, and following the nomenclature of Rcf. [26], 
we use " intensity" to refer to the sum of input coupling 
strengths. For general couplings, (4) remains valid if 
the degree is replaced by the intensity. This means that 
the average of the Laplacian eigenvalues is equal to the 
average degree (or intensity) (k) for the whole network, 
and consequently (k) is a convenient scaling factor for 
comparing spectra of different networks. 1 
A useful identity is the following: 

X L v XiX i = Yl Wi i ( Xi - x rf' ( 5 ) 

i,3 i,3 

where Xi may be any quantity associated with each node 
(in the context of synchronization, it could be the phase 
of each oscillator). The above guarantees that, as long 
as the couplings are non-negative, then the Laplacian is 
positive semi-definite; i.e., all of its eigenvalues are pos- 
itive or zero. If Xi represents a perturbation of some 
dynamical degree of freedom (such as the phase of an os- 
cillator) then (5) suggests a heuristic interpretation of L 
as a tensor expressing the rigidity of the network against 
such perturbations. In particular, if the perturbation is 
a multiple of one of the normalized eigenvectors, or in 
other words if 

Xi = nVf, 

then 

Wij(xi - Xjf- = \ a r] 2 . (6) 

The left-hand side of eq. (6) is a sum of squared differ- 
ences across links, weighted by the strength of each link; 
it can be imagined as a sum of potential energies due to 



1 Another procedure is necessary in cases where < k > is not well- 
defined, such as the thermodynamic limit of scale-free networks 
with small power-law exponents. 



stretched bonds. If the eigenvalue X a is small, then the 
perturbation along the corresponding vector can occur 
without disturbing very many strong bonds, and the op- 
posite is true if A Q is large. With this interpretation in 
mind, the zero mode (1, 1, ...1) indicates the freedom of a 
uniform translation of the whole network (in the case of 
coupled oscillators, it is the freedom to reset all phases 
by an equal amount without affecting any links.) 

The definition (1) shows a deceptively simple relation- 
ship between the adjacency (or coupling) matrix and the 
Laplacian. However, it is only in the special case of a 
so-called regular network (i.e., one in which the degree 
or the sum K = J^j Wij is the same for all i), that 
the two matrices commute and thus are guaranteed to 
share a common eigenbasis. In this special case, the 
corresponding eigenvalues A Q for the Laplacian and \i a 
for the coupling matrix are related by A Q = \i a — K. In 
general, it is easy to show that the commutator 

[W, L] = WL — LW (7) 

is a matrix whose elements are proportional to the differ- 
ences between the degrees of adjacent nodes. This leads 
us to expect that the differences in spectrum between the 
two matrices become more important as the network be- 
comes more heterogeneous, but on the other hand can 
be lessened by what is called assortative mixing[27] (i.e., 
a tendency of nodes to connect with other nodes of sim- 
ilar degree.) 



III. TOPOLOGY AND LAPLACIAN SPECTRA 

In this section we examine the shapes of the Lapla- 
cian spectra of several types of networks, and consider 
how specific features of the spectra are correlated with 
structural features of the networks. We will begin with 
networks in which all existing links are bidirectional and 
equally weighted, and then consider certain types of 
asymmetries. Except where otherwise indicated, the 
networks we study have N — 1000 nodes and average 
topological degree (k) = 20. Figures 1 A,B show his- 
tograms of the (scaled) Laplacian eigenvalue distribu- 
tions for random (Erdos-Renyi [28]) networks with Pois- 
son degree distribution (henceforth referred to as a Pois- 
son network or PN) and Barabasi- Albert [29] networks 
with scale- free distribution (a scale- free network or SFN). 
The first thing to note is the dependence of the spectrum 
on the degree distribution. The eigenvalue distributions 
share some statistical features of the degree distributions: 
for example, the eigenvalue spectrum of the SFN has a 
power-law tail just as does the degree distribution. For 
the Poisson networks, on the other hand, the spectrum 
has a Poisson-like single peak with no significant tail. 
When we varied (k) from 5 to 40 (plots are not shown 
here), we found that the relative width (or width scaled 
by (fc)) of this peak decreases with increasing (fc) but 
that other qualitative features are the same. 
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FIG. 1: Histograms of scaled Laplacian eigenvalues for Pois- 
son and scale-free networks with low and high clustering co- 
efficients. Each histogram is cumulative for five different 
networks drawn from the same ensemble. 



We next examine the effect of clustering, which is 
known to have strong effects on the synchronizability 
of networks. [30] We applied a stochastic rewiring algo- 
rithm [31][30]to increase the clustering coefficient of the 
PN and SFN while leaving the degree distributions un- 
changed. Clustering (also called transitivity) refers to 
the tendency of two nodes which share a common neigh- 
bor to have an increased likelihood of also being directly 
connected to each other (compared to two nodes that do 
not share a neighbor) [6]. Put another way, clustering 
indicates the prevalence of triangles in the network topol- 
ogy. The clustering coefficient 7, a numerical measure 
of clustering, is defined as an average over the network 
of the local clustering coefficient, given by 

where U is the number of mutual connections among the 
neighbors of a given node, fcj is the number of neighbors, 
and (o) is the number of possible pairs of neighbors that 
could potentially be connected. The bottom row of plots 
in figure 1 show the spectra of networks with the same 
degree distributions as the ones above, but with high 
clustering coefficients, specifically 7 = 0.640 ± 0.005 for 
the PN's and 7 = 0.675 ± 0.005 for the SFN's. For the 
"natural" low-clustering networks whose spectra are in 
the upper row of figure 1, the values are within the range 



7 = 0.0195 ± 0.0005 for the PN's and 7 = 0.073 ± 0.005 
for the SFN's. It is apparent that for both the PN and 
SFN, increasing the clustering changes the shape of main 
spectrum slightly, sharpening the peak and shifting it to 
the right, while also creating a new group of eigenvalues 
close to zero. A series of plots at intermediate values of 
7 (not given here) shows that as 7 increases, this group 
of eigenvalues breaks away from the main peak and grad- 
ually migrates downward toward zero. 

The presence of near-zero eigenvalues generally indi- 
cates the existence of strong communities, or nearly dis- 
connected components. The multiplicity of the (exactly) 
zero eigenvalue is equal to the number of disconnected 
components [15]. Strong communities (subsets of nodes 
with much fewer connections between groups than within 
groups) behave like nearly disconnected components and 
thus result in small but nonzero eigenvalues. Low eigen- 
values and the corresponding eigenvectors have been used 
in some algorithms for partitioning and/or detection of 
communities. The most common application is to find 
an optimal partitioning of the network into two commu- 
nities by means of the eigenvector corresponding to the 
second-lowest (or lowest non-zero) eigenvalue, a proce- 
dure which may be applied iteratively. [32] More recently, 
however, techniques for finding communities have made 
use of the space spanned by the lowest few eigenvectors 
rather than only one. [33] [34] The essential technique is 
as follows: the m eigenvectors with the lowest nonzero 
eigenvalues are found, and each node is assigned m coor- 
dinates which are the entries of the m eigenvectors at the 
position of that node. When these coordinates are plot- 
ted for all nodes, communities, if they exist, appear as 
groups of nodes clumped together in this m-dimcnsional 
space. The clumps may be readily observable by eye; 
alternatively, one may use statistical techniques such as 
hierarchical clustering[33] to find the optimal grouping 
into clumps. We have made such a plot for the first 
three eigenvectors of the high- and low-clustering SFN's 
in Fig. 2. The plot clearly shows that the nodes of 
the high-clustering network group together into commu- 
nities while those of the low-clustering network do not. 
In examining synchronization dynamics in section V, the 
low-lying eigenvectors will give a good indication of the 
dynamical importance of communities. In view of the 
interpretation of L as giving the network's inherent rigid- 
ity against perturbations, the low-lying eigenvectors as- 
sociated with communities reflect the relative ease with 
which the network can fall apart (or desynchronize) along 
community boundaries. 

Although in network studies it it most common to con- 
sider networks with symmetric, undirected links, Motter 
et al. [25] [26] have shown for a variety of topologies that 
the MSF synchronizability as measured by the eigenratio 
Xn I A2 is improved by a particular scheme of asymmetric 
coupling which we refer to here as input normalization 
or simply normalization. This is a weighting in which 
the input coupling strengths to any node are scaled so 
that their sum is unity. Put another way, the coupling 
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FIG. 2: Scatter plots of the components of the Laplacian 
eigenvectors with the lowest three nonzero eigenvalues for 
scale-free networks with low (top) and high (bottom) clus- 
tering. In the high-clustering case, communities appear as 
clumps of nodes. 



matrix is derived by dividing each row of the adjacency 
matrix by the degree of the corresponding node: 

Wij = Aj/ki = =^L-. (9) 

In a heterogeneous network, this implies that the cou- 
plings are not symmetric. If a hub node H with high 
degree is connected to a peripheral node P with low de- 
gree, then the influence of H on P is greater in absolute 
terms than that of P on H. P's influence on H is di- 
luted by H's many other neighbors. Motivated by the 
enhanced synchronizability of normalized networks, we 
are interested in understanding the effect of normaliza- 
tion on the full Laplacian spectrum (and subsequently 
on dynamics), not only the extremal eigenvalues. In 
spite of the asymmetry introduced into the coupling and 
therefore the Laplacian, it can be proved [25] that the 
Laplacian eigenvalues are still all real in this case. Fur- 
thermore, the intensities of all nodes are unity, so that, 
as discussed above, the Laplacian has a common eigen- 



basis with the coupling matrix. (Due to the asymmetry, 
however, the eigenvectors are not mutually orthogonal.) 
The eigenvalue spectrum is in fact the same as for what 
is known in graph theory as the " normalized Laplacian," 
[16] [17] of the underlying unweighted network, although 
the eigenvectors themselves are not the same. To sum- 
marize the relationships among the matrices, let D be the 
diagonal matrix whose entries are the topological degrees, 
let L u and L„ be the Laplacians of the unnormalized and 
normalized networks repectively, while C is the symmet- 
ric "normalized Laplacian." Then the relationships are: 

L„ = D A (10) 
L„ = L U D 

£ = D- 1 / 2 L U D- 1 / 2 . 



Figure 3 shows eigenvalue histograms for the same net- 
works as in Figure 1, but with the inputs normalized. 
The first striking feature is that the spectra look very 
nearly the same for both the PN and the SFN. As was 
found in [26] , the effect of degree heterogeneity is greatly 
suppressed by normalization; we will see that this is also 
true of the effect of degree distribution on dynamics. In 
the low clustering case, the spectra have approximately 
semicircular shapes for both networks, recalling the so- 
called semicircle law[35] for spectra of random matrices. 
Previously, the normalized Laplacians of a broad class 
of uncorrelated random matrices (including the Erdos- 
Renyi but not, strictly speaking, the Barabasi- Albert net- 
work) were found to obey the semicircle law [17], as were 
the closely related transition matrices [22]. Consistent 
with what is known about the eigenratio[25], the spectra 
are much narrower than for the unnormalized networks, 
with no apparent tail either of the exponential or power- 
law type. 

Increasing the clustering of the normalized networks 
narrows and markedly sharpens the main spectral peak 
into a more triangular shape. The other main effect of 
clustering, namely the creation of a second peak near 
zero, is much the same as in the unnormalized net- 
works. This is consistent with our understanding of the 
low modes as being associated with community struc- 
ture. Communities are a topological phenomenon, the 
result of a paucity of connections among the different sub- 
sets. If there are only a few connections between two 
subsets of the network, then an adjustment of coupling 
strengths alone is unlikely to compensate significantly for 
this scarcity, unless some bias results in extra strength- 
ening of inter-community ties at the expense of others. 
Input normalization certainly alters the dynamical roles 
of high- vs. low-degree nodes, but it is not surprising 
that it has little effect on such global topological features 
as community formation. 
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FIG. 3: Eigenvalue histograms for networks with normalized 
inputs (Eq. 9). The networks are topologically the same as in 
figure 1; only the connections strengths have been changed. 
Since all nodes have a coupling sum of unity, the scaling factor 
(ft) is not needed here: the eigenvalues A in figs. 3,7 and 8 
are comparable to the scaled values A/(fc) in figs. 1, 5 and 6. 



IV. SHAPES OF THE EIGENVECTORS: LOCAL- 
IZATION AND DELOCALIZATION 

To the extent that different Laplacian eigenvectors are 
associated with collective degrees of freedom having dif- 
ferent dynamical functions, it is interesting to exam- 
ine the "shapes" of these vectors and understand how 
they relate to the network's structure. In figure 4, we 
plot the components V" of several representative eigen- 
vectors against the node index i where the nodes have 
been sorted from lowest to highest degree. While all 
plots appear partly random, reflecting the randomness 
in the network's structure, there are nonetheless pat- 
terns that are clear from a visual inspection, and clear 
qualitative differences between different vectors. Some 
vectors, such as the one shown in Fig. 4B, are highly 
localized, with only a few large nonzero components and 
the rest nearly zero, while others such as the one in frame 
A have nonzero components spread throughout the whole 
network. Some, such as C or D, show a degree bias; 
most of their large components occur at nodes within a 
certain degree range (either high, low or intermediate). 
The vector in E is an example of one of the low-lying 
modes in a strongly clustered network. The components 
cluster around a small number of discrete values. Nodes 
having the same value of Vi are likely to belong to the 
same community. (As described above, the communities 
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FIG. 4: Examples of different shapes of Laplacian eigenvec- 
tors. Each is typical for one type of network and a particular 
range of eigenvalues. x coordinates are the node index, 
where the nodes have been sorted from lowest to highest de- 
gree; y coordinates are the eigenvector components. (A) 
Low-clustering PN, vector a = 500 (i.e., the vector with the 
500th lowest eigenvalue), A = 19.27. This vector is delocalized 
and its components appear random. (B) Low-clustering PN, 
a — 4, A = 7.97. This vector is strongly localized: note the 
single large component at i « 810 (C) Low-clustering SFN, 
a = 800, A = 23.74. Not strongly localized, but most large 
components occur at nodes within a medium to high range of 
degrees. (D) Low-clustering SFN, a = 50, A = 8.26. Largest 
components occur at low-degree nodes. (E) High-clustering 
PN, a = 4, A = 0.86. This is an example of the low- lying 
modes that form in networks with high clustering. Compo- 
nents fall near a small number of discrete values, giving the 
plot a striated appearance. 



are separated more distinctly if several low-lying eigen- 
vectors are plotted simultaneously.) 

A convenient scalar measure of a vector's degree of 
localization is the so-called inverse participation ratio [36] 
(IPR) P, which is defined for any vector V by 



P(V) = 



E^ 4 
(E^ 2 ) 2 ' 



(ii) 



(Note that the denominator is 1 if the vector is normal- 
ized.) P ranges from a minimum value of 1/N (for 
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a normalized vector whose components are all of equal 
magnitude \/\f~N) to a maximum of 1 for a vector with 
only one nonzero component. The more localized the 
vector (ie., the less evenly its weight is spread among 
multiple components) the higher the value of P. In or- 
der to quantify the degree bias noted for some of the 
eigenvectors, let us define the degree expectation value 
(DEV) Q for a vector as 

V V 2 k 

Q(V) = Ifrjpr. (12) 

(Some other authors[23] have used instead the "center 
connectivity," which is simply the degree of the node 
with the maximum value of \Vi\. The center connec- 
tivity should be nearly identical to the DEV in cases of 
vectors localized very strongly at a single node, but Q, 
being an average, is likely to be a more robust and mean- 
ingful metric in cases such as panel (C) of Fig. 4 where a 
vector has some level of localization and degree bias but 
no single component is dominant.) 

Figures 5-8 show values of P and Q/(k) (i,e., the DEV 
scaled by the average degree) for the Laplacian eigen- 
vectors of several networks, plotted against the corre- 
sponding scaled eigenvalues \/(K). (Note that while 
Q is appropriately scaled by the average topological de- 
gree, the eigenvalues are scaled by the average intensity, 
which is equal to the topological degree for the unnor- 
malized networks but unity for the normalized ones.) In 
the plots for the unnormalized networks (figs. 5 and 6), 
several features are notable. Among modes within the 
main spectral peak, those near the edges tend to be 
more strongly localized. For both Poisson and scale- 
free networks, increased clustering tends to increase the 
localization of modes, especially in the tails of the eigen- 
value distributions. The DEV's are positively correlated 
with the eigenvalues, especially in the scale-free case 
and for the tails of the eigenvalue distributions. An ex- 
ception to these trends is the group of low-lying modes 
that form at high clustering. These modes are gener- 
ally rather delocalized and have Q close to the average 
degree of the network. This is consistent with their 
interpretation as reflecting global community divisions 
of the network, involving most of the nodes. We note 
that our results for the spectra, IPR's and DEV's for the 
low clustering Poisson networks agree with random net- 
work results reported elsewhere [23]. The other results 
are largely consistent with the general principle that lo- 
calization tends to occur near "defects" or nodes with 
degrees significantly higher or lower than average. [23] A 
notable exception occurs for the strongly clustered SFN, 
where there is a large group of moderately to strongly 
localized modes with scaled eigenvalues near unity (see 
fig. 5). From fig. 6 it is evident that the DEV's of these 
modes fall near the average of the degree distribution, 
not the tails. 

Analogous plots of eigenvector properties for normal- 
ized networks (figs. 7 and 8) show radical differences from 
the unnormalized case. First, there is much less localiza- 
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Eigenvalue XJ<k> /<k> 

FIG. 5: (color online) Inverse participation ratios P a (eq. 11) 
of Laplacian eigenvectors for unnormalized networks, plotted 
against the corresponding scaled eigenvalues. Here and in 
all of figs. 5-8, different symbols (colors) are for five different 
networks from the same ensemble. 



tion of modes, even at high clustering. The dependence 
of DEV on eigenvalue is much weaker and not monotonic. 
Rather, the main peak of the spectrum is approximately 
symmetric about A = 1. In the normalized network 
unlike the unnormalized case, the Laplacian spectrum is 
directly related to that of the coupling matrix, and a 
Laplacian eigenvalue of 1 corresponds to a coupling ma- 
trix eigenvalue of zero. It is a general property of random 
graphs that their adjacency matrix spectra are approx- 
imately symmetric about zero (deviations from symme- 
try occur when there are correlations or clustering) [20]. 
The spectra of normalized networks evidently share this 
approximate symmetry, although the coupling matrix in 
this case is not the same as the adjacency matrix. It 
should be kept in mind that the eigenvectors of L for a 
normalized network are not orthonormal. 

In contrast to the main peak, the low-lying modes of 
strongly clustered networks behave qualitatively much 
like those in unnormalized networks, suggesting again 
that community structure is scarcely affected by normal- 
ization. 

Without making a thorough analysis of the dependence 
of spectra on (k) or the finite size N, we note that im- 
portant qualitative features appear to be independent of 
(k) . As an example of this observation, in figure 9 we 
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Eigenvalue ^ a /<k> ^ /<k> 



FIG. 6: (color online) Scaled degree expectation values 
Q a /{k) (eq. 12) for Laplacian eigenvectors of unnormalized 
networks. Eigenvalues and DEV's are strongly correlated in 
all cases (a dotted line with slope 1 is shown for comparison). 



FIG. 7: (color online) Inverse participation ratios P a of Lapla- 
cian eigenvectors for normalized networks. 



plot inverse participation ratios versus eigenvalues for the 
Laplacian eigenvectors of a strongly clustered SFN with 
TV = 1500, (A;) = 10 and clustering coefficient 7 = 0.560. 
This may be compared with the corresponding plot in 
figure 5 for the case (k) = 20; the peculiar shapes match 
quite closely. 



V. SPECTRA, EIGENCOORDINATES AND DY- 
NAMICS 

In this section, we examine numerically the syn- 
chronization behavior of a network Kuramoto[ll] model 
on the networks we have been studying. Topologi- 
cal features (degree distribution, clustering, normaliza- 
tion) have strong and sometimes complex effects on 
synchronization. [30] [25] [26] [12] We show that projections 
onto the Laplacian eigenbasis are useful in understand- 
ing these effects, and that specific dynamical behaviors 
of the networks are associated with specific sets of modes 
in the Laplacian spectrum. This is true even in strongly 
nonlinear regimes of partial synchronization, despite the 
fact that the Laplacian is most naturally applied to linear 
problems near full synchronization. 

We first define the model and show how the Laplacian 
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FIG. 8: (color online) Degree expectation values Q a for Lapla- 
cian eigenvectors of normalized networks. 
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FIG. 9: Inverse participation ratios vs. eigenvalues for the 
Laplacian eigenvectors of a highly clustered SFN with N — 
1500, (fc) = 10 and clustering coefficient 7 = 0.560. The 
plot is quite similar to that in figure 5 despite the different 
network sizes and connectivities. 



and its spectrum appear naturally in a linearized descrip- 
tion of the frequency-synchronized state, and then we 
proceed to use the Laplacian eigenvectors to parametrize 
the partially desynchronized states, showing that this co- 
ordinate system remains useful well beyond the range of 
validity of the linearization and that individual modes 
may behave as quasi-independent degreess of freedom. 
Our model[37] is defined by the coupled equations 

^ = ^ + m^ Wii sin( ^ " ^ (13) 

3 

where fa are N phase variables (one associated with each 
node of a network) , — 1 < Wj < 1 are the randomly and 
uniformly distributed intrinsic frequencies, (3 is the over- 
all coupling strength, and Wij as before is the weight- 
ing matrix of the individual couplings. The coupling 
strength is scaled by the average intensity (K) of all 
nodes. In our simulations, we imposed the condition 
ZJ = by subtracting the average from each realization of 
the random frequencies. (This condition can be imposed 
without loss of generality; it amounts to a transformation 
to a rotating frame of reference.) If the couplings are 
symmetric, then the velocities -J^ obey the exact sum 
rule 

i i 

due to the antisymmetry of the sine coupling function: 
when summed over i, the coupling terms in equation (13) 
cancel. Note that eq. (14) does not necessarily hold 



for a normalized network, due to the asymmetry of the 
coupling Wij. 

If the system is strongly synchronized so that all phase 
differences are small, then the sine function can be lin- 
earized and the equations of motion become approxi- 
mately 

^ = Wi + j^^Wijifa - fa) =Ui- j^J2 £i ^i- 

(15) 

Thus the Laplacian matrix appears naturally in the de- 
scription of small deviations from full synchronization. 

We simulated the model (13) using a fourth-order 
Runge-Kutta method with time step 0.1. In figure 10 
we show the global synchronization order parameter 




(Where () T signifies a time average) as a function of the 
coupling strength j3 for all of the network types consid- 
ered in the previous sections. In the simulations, the 
time average was approximated by sampling 30 times 
at intervals of 10 time units, after first runnimg for 200 
time units in order to reach a steady state. The results 
were then averaged over 10 realizations of the random fre- 
quency distribution for each of five networks drawn from 
the ensemble. Note that in all cases, increasing the clus- 
tering strongly suppresses full synchronization, as shown 
by the fact that the order parameter curves for the highly 
clustered networks approach unity much more slowly at 
large coupling strength. This effect is more pronounced 
for the SFN than for the PN, whether normalized or not. 
For the unnormalized SFN, however, increased cluster- 
ing has the seemingly contradictory effect of promoting 
the onset of partial synchronization even though it in- 
hibits full synchronization. This effect, noted previously 
in [30] and confirmed by finite size scaling analysis [38] is 
apparent in the early upward turn in the order parame- 
ter curve at (3 w 0.5. It was found previously that it is 
the highest-degree nodes which synchronize first. This 
advanced partial synchronization disappears, however, in 
the case of normalized inputs. Since the advanced syn- 
chronization is associated with a special behavior of the 
high-degree nodes, its disappearance is consistent with 
the general observation that input normalization greatly 
reduces the effects of degree heterogeneity. 

In [30] it was shown that nodes in different parts of the 
degree distribution can play different dynamical roles: for 
example, in the case of the SFN it is the hubs (high- 
degree nodes) that synchronize first. A complementary 
way of viewing the synchronization dynamics is to exam- 
ine it in terms of appropriately chosen collective degrees 
of freedom rather than the behavior of individual oscilla- 
tors. Here as in [19], we define collective coordinates by 
means of projections onto eigenvectors of the Laplacian. 
We define projections of the phase and frequency vectors 



9 



Poisson 




FIG. 10: Global order parameter vs. coupling strength for 
Poisson and scale-free networks with low and high clustering. 
Solid line: low clustering; dashed line: high clustering. For 
the unweighted SFN's, note that there is a range of low cou- 
plings 0.3 < P < 0.7 for which the highly clustered network 
is more synchronized than the low-clustering one. 
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FIG. 11: (color online) : Plots of selected mean square normal 
velocities ((Q a ) 2 ) LJ as functions of coupling strength (3 aver- 
aged over 300 time units and 100 realizations of the intrinsic 
frequencies u, for a single highly clustered Poisson network. 
Each curve is labelled with the scaled eigenvalue correspond- 
ing to a. The two lowest (and farthest left) curves cor- 
respond to eigenvalues at the high and low ends of the main 
spectral peak, while the other two curves are for modes within 
the low- lying second peak of "community" modes. The dif- 
ferent velocity components drop to zero at different rates, and 
ones corresponding to high eigenvalues lock (or drop to zero) 
at lower coupling strengths. 



onto these eigenvectors by 

#* = Y t <l>iV?,w a = Y l o>iV?, (17) 

i i 

The normal coordinates 4> a are the appropriate ones 
for describing the relaxation to equilibrium of a strongly 
synchronized system [30] [18]. In addition, we define the 
observed frequencies (rotation numbers) of the oscillators 
as the time averages 

* -<£>,.■ 

Projecting the vector of observed frequencies onto the 
Laplacian eigenbasis gives a time-averaged velocity along 
the direction defined by each eigenvector: 

n a = Y,^jV 3 a - ( 19 ) 

3 

For the purpose of elucidating the network dynamics, we 
found these normal velocities more useful to work with 
than the normal coordinates themselves for two reasons. 
First, from a computational point of view, it is easier 
to construct time averages of the velocities as one re- 
quires only initial and final phases (not modulo 2-7T for 



this purpose) together with the elapsed time. Second, 
we found that plots of the velocities as functions of cou- 
pling strength displayed sharper transitions and clearer 
patterns than averages (or mean squares) of coordinates. 

Figure 11 shows plots of the mean square velocities 
((£! Q ) 2 ) as functions of coupling strength (3 for four dif- 
ferent values of a taken from different parts of the spec- 
trum for a highly clsutered Poisson network. The time 
averages Q a were taken over an interval of 300 time units 
and the squares were averaged over 100 realizations of the 
random frequencies. The different ((f2 Q ) 2 ) values fall to 
zero at different rates, so that the eigendirections associ- 
ated with high eigenvalues become locked (i.e., the corre- 
sponding velocities become zero) at lower values of (3 than 
the ones associated with low eigenvalues. Similar trends 
were noted for SFN's in [19]. The normal velocites give 
more detailed information about synchronization than a 
global order parameter. The evolution with increas- 
ing (3 from complete incoherence to complete frequency 
synchronization can be visualized as a series of quasi- 
independent locking transitions in which different normal 
modes effectively drop out of the active dynamics. As 
eigendirections successively lock, the phase space of the 
oscillator system can be viewed as contracting onto pro- 
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gressively lower-dimensional subspaces spanned by the 
remaining eigenvectors. Modes with very low eigenval- 
ues are very difficult to lock, and therefore their presence 
will inhibit complete synchronization. Evidently these 
low modes are correlated with the difficulty of full syn- 
chronization in highly clustered networks. 

To the extent that the modes behave as independent 
degrees of freedom, one can view each mode as having 
its own individual transition point, a critical coupling 
strength above which that mode is locked. To obtain 
numerical estimates of these individual transitions, we 
considered a mode to be locked when the value of ((f2 Q ) 2 ) 
falls below a threshold of 0.01. (Since we are measur- 
ing an average over frequency realizations, this means 
that for the majority of realizations the value of £l a is 
actually zero within the resolution of our numerical mea- 
surement.) Frequencies were measured at a sequence 
of values of for one network of each of the types we 
studied. As in figure 11 The frequencies were time 
averaged over 300 time units, and their squares were av- 
eraged over 100 realizations of the random intrinsic fre- 
quencies. The transition points C were estimated by 
means of a cubic spline interpolation of the numerical 
measurements. The results are plotted in figures 12 
and 13. The patterns are somewhat different for each 
type of network, but as a general rule C is a decreasing 
function of the eigenvalue A. In some of the networks, 
a finite subset of the modes all lock at the same value 
while the remainder lock and unlock independently. Ev- 
idently, some modes are strongly mutually coupled while 
others arc more independent. For the strongly clustered 
SFN, for example, it is evident from fig. 12 that a number 
of high modes lock simultaneously at a quite low value 
of = 0.5. This group of modes apparently represent 
the degrees of freedom responsible for the advanced par- 
tial synchronization of this network and the upward turn 
in the global order parameter in fig. 16. For the nor- 
malized networks, all modes within the main spectral 
peak lock almost simultaneously, and only the lower set 
of modes (in highly clustered networks) have significant 
spread in their values of C . The low-eigenvalue modes 
that form at high clustering are difficult to lock, and it is 
evidently these modes that are responsible for the inhi- 
bition of complete synchronization in the cases of highly 
clustered neworks. Since these modes are associated 
with the divisions among communities, this suggests that 
the frequency clusters noted at moderately high in [30] 
are identical to topological communities. The degrees of 
freedom that inhibit full synchronization are clearly dif- 
ferent from the ones responsible for the advanced partial 
synchronization of SFN's. 



VI. CONCLUSIONS 

We have examined the Laplacian spectra for several 
types of complex networks, seeing the effects on the 
spectra of degree distribution, clustering, and of coupling 
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FIG. 12: Transition points fi c for individual eigenvectors of 
unnormalized networks. j3 c is the coupling strength at which 
each mode locks as defined by the criterion ((Q a ) 2 } < 0.01. 
Eigenvalues are plotted on a logarithmic scale in order to 
reveal the trend at low eigenvalues. 
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FIG. 13: Mode transition points f3 c for normalized networks. 



scheme (in particular, equal and bidirectional couplings 
versus input normalization.) We found that increasing 
clustering has two main groups of effects on the eigen- 
value spectrum. The first set of effects alter the shape 
and composition of the main spectral peak. More local- 
ized modes are formed in and around this peak, and the 
correlation between eigenvalue and degree expectation 
value generally becomes stronger. Second, increased 
clustering creates an additional group of delocalized low- 
eigenvalue modes which are associated with an increased 
modularity (community structure) of the network. As 
expected, input normalization greatly reduces the in- 
fluence of degree heterogeneity compared to the unnor- 
malized network, and this is reflected in a greater uni- 
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formity of the spectra. Normalization, however, docs 
not significantly alter the effect of clustering on commu- 
nities and the low modes associated with them. In 
general, study of the Laplacian spectra and the proper- 
ties of the eigenvectors reveals complex structures whose 
significance should be explored further in future work. 
Many qualitative features are independent of the average 
degree < k > but depend only on the type of topology 
and coupling scheme. Some peculiar details of the spec- 
tral shapes we have observed remain to be fully explained 
(see, for example, figs. 5 and 8.) 

We found that when coordinates based on the Lapla- 
cian eigenbasis are used to examine the dynamics of a net- 
work of coupled phase oscillators, the transition to syn- 
chronization can be visualized in ways that are not appar- 
ent from global order parameters alone. Roughly speak- 
ing, extremal eigenvalues give information about the on- 
set of synchronization or desynchronization, whereas the 
full spectrum is relevant to the full process of synchro- 
nization. In particular, in many cases, modes or groups 
of modes make quasi-independent transitions to synchro- 
nization as the coupling strength is increased, with low 
modes synchronizing at higher coupling strengths. The 
process of synchronization can be viewed as a contraction 
of the dynamics onto progressively lower-dimensional 
submanifolds of the phase space as different eigenmodes 
lock one by one. The presence of low-lying modes, which 
are hard to lock, can significantly retard the achieve- 
ment of full synchronization. The quasi-indcpcndcncc 
of eigenvectors is a somewhat surprising result in a highly 
nonlinear regime of partial synchronization. Previously 
the Laplacian was applied only to the linear stability of 



a perfectly synchronized state. 

Unlike the situation with the linear (MSF) problem, 
in the regime of partial synchronization a knowledge of 
the eigenvalue spectrum alone is not sufficient to predict 
the full dynamics. The dependence of transition point 
on eigenvalue is different for each type of network even 
though the broad trend (the transition point is a decreas- 
ing function of eigenvalue) is the same for all. But the 
spectrum is nonetheless a source of at least heuristic in- 
sight into the dynamics, and particular groups of eigen- 
vectors can be directly associated with aspects of the 
dynamics: for example, high modes with the advanced 
transition in high-clustering SFN's, or low modes with 
frequency clustering and the inhibition of full synchro- 
nization. 

In the future, diagnostic techniques based on the 
Laplacian spectrum can be applied to other types of net- 
works. It may be worthwhile to examine spectral effects 
of assortative mixing, and to test our conjecture that 
assortative mixing should bring the Laplacian and ad- 
jacency matrix spectra into closer congruence. It may 
also be interesting to attempt a finite size scaling analyis 
of the separate transitions undergone by different normal 
modes. Just as one gains important information by con- 
sidering the full process of synchronization and not only 
the onset [38], one also gains information by examining 
the full spectrum of eigenvectors. 
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